Skip to content

Write file_changes diff sidecar - #1581

Merged
christso merged 1 commit into
mainfrom
feat/file-changes-diff-sidecar
Jun 30, 2026
Merged

Write file_changes diff sidecar#1581
christso merged 1 commit into
mainfrom
feat/file-changes-diff-sidecar

Conversation

@christso

Copy link
Copy Markdown
Collaborator

Summary

Adds an explicit file_changes_path artifact contract and writes the full workspace diff to outputs/file_changes.diff whenever a result has fileChanges. This removes the truncated workspace_changes.diff_summary from grading artifacts while preserving structured created/modified/deleted file visibility.

Changes

  • Write the canonical full file_changes diff as a per-run outputs/file_changes.diff sidecar.
  • Expose file_changes_path in result/index/metrics artifact metadata using snake_case wire fields.
  • Remove workspace_changes.diff_summary from grading.json and add deleted-file count/list coverage.
  • Update CLI/core tests and public artifact-contract docs for the new sidecar.

Testing

  • git diff --check origin/main...HEAD
  • bun test apps/cli/test/commands/eval/artifact-writer.test.ts
  • bun test apps/cli/test/commands/grade/grade-prepared.test.ts
  • bun test packages/core/test/evaluation/workspace/file-changes.test.ts
  • Live dogfood eval with Codex target and Azure LLM grader passed 1/1; verified the full diff sidecar, explicit path fields, deleted-file metadata, and absence of diff_summary.

@cloudflare-workers-and-pages

cloudflare-workers-and-pages Bot commented Jun 30, 2026

Copy link
Copy Markdown

Deploying agentv with  Cloudflare Pages  Cloudflare Pages

Latest commit: 810864b
Status: ✅  Deploy successful!
Preview URL: https://2bd883e9.agentv.pages.dev
Branch Preview URL: https://feat-file-changes-diff-sidec.agentv.pages.dev

View logs

@christso
christso force-pushed the feat/file-changes-diff-sidecar branch from 9837c7f to 810864b Compare June 30, 2026 13:39
@christso
christso marked this pull request as ready for review June 30, 2026 13:42
@christso
christso merged commit 29badf6 into main Jun 30, 2026
8 checks passed
@christso
christso deleted the feat/file-changes-diff-sidecar branch June 30, 2026 13:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant